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SUMMARY 


Problem 

Navy  personnel  records  are  becoming  more  computerized,  and 
design  of  the  human/computer  interface  must  be  considered  in 
order  to  increase  data  entry  productivity  as  well  as  reduce  entry 
errors.  To  enhance  these  design  considerations,  functional 
relationships  of  operator  performance  are  needed  which 
incorporate  a  variety  of  system,  task,  operator,  and 
environmental  factors. 

Objective 

The  purpose  of  this  study  i3  to  demonstrate  the  utility  of 
using  three  classes  of  metrics,  including  work  sampling,  embedded 
performance  measures,  and  satisfaction  ratings,  to  evaluate  the 
■'  -nan/computar  interface  for  data  entry  of  personnel  records. 
Each  class  of  measures  was  used  to  generate  functional 
relationships  between  operator  performance  and  four  system 
parameters  including  system  response  time,  display  rate,  keyboard 
echo  rate,  and  keyboard  buffer  length. 

Method 

A  simulated  data  entry  task  was  structured  around  a  Navy 
personnel  records  task  in  which  the  operator  was  required  to  use 
an  interactive  computer  terminal  to  perform  either  ADD  or  CHANGE 
transactions  on  simulated  pay  order  records.  An  orthogonal, 
central-composite  design  was  used  to  specify  the  data  collection 


retirements  for  evaluating  the  four  system  timing  variables.  A 
total  of  400  transactions  were  evaluated  across  22  different 
dependent  variables  representing  the  three  classes  of  metrics 
evaluated  in  this  study. 

Results 

Both  univariate  and  multivariate  analyses  were  conducted  on 
the  data  in  order  to  generate  a  series  of  second-order  polynomial 
regression  equations.  The  univariate  polynomial  regression 
equations  described  the  functional  relationships  between  the  four 
system  timing  variables  for  each  of  the  22  separate  dependent 
variables.  The  most  important  variables  included  time  spent 
looking  at  the  display,  time  spent  looking  at  the  keyboard  while 
typing,  typing  rate,  and  overall  operator  satisfaction.  The 
multivariate  polynomial  regression  analyses  provided  functional 
relationships  in  terms  of  three  composite  measures  representing 
production,  waiting,  and  planning  activities  of  the  operator. 
Although  all  four  system  variables  were  significant  in  various 
evaluations,  the  most  important  system  timing  variables  across 
all  analyses  were  the  system  response  time  and  keyboard  echo 
rates. 

Conclusions 

All  three  classes  of  metrics  (i.e.,  work  sampling,  embedded 
performance  measures,  and  operator  satisfaction  ratings)  are 
needed  to  provide  a  complete  analysis  of  the  effects  of  the  four 
system  variables  on  operator  behavior.  By  using  these  three 
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classes  of  measures  and  representing  the  functional  relationships 
in  terms  of  response  surfaces,  the  system  designer  can  easily 
superimpose  the  various  surfaces  to  make  the  necessary 
human/computer  interface  design  tradeoffs.  Additionally,  a  more 
general  interpretation  of  the  h-uman/computer  interface  can  be 
made  by  using  multivariate  response  surfaces  representing 
operator  production,  waiting,  and  planning  activities. 

Recommendation 

Additional  research  is  needed  to  validate  the  three  general 
multivariate  activities  which  characterized  the  human/computer 
interface  in  this  personnel  records  task.  A  variety  of  other 
human/computer  interface  tasks  need  to  be  evaluated  by  this 
procedure  to  investigate  the  robustness  of  these  dimensions  as 
well  as  the  differential  weightings  of  these  dimensions  across 
tasks. 
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INTRODUC  flOtf 


Problem 

Navy  personnel  records  are  becoming  more 
computerized  both  to  increase  the  productivity  of 
personnelmen  who  enter  and  update  records  and  to  reduce 
the  number  of  data  entry  errors.  Two  current  Navy 
systems,  the  Manpower  and  Personnel  Information  System 
(MAPMI3)  and  the  Joint  Uniform  Military  Pay  System 
(JUMPS) ,  are  extremely  large  scale  information 
management  systems  that  receive  widespread,  distributed 
entry  from  over  3000  field  offices.  Source  data  entry 
to  each  system  is  extremely  labor  intensive;  it  has 
been  estimated  that  approximately  25%  of  the  time  of 
individuals  holding  personnelman  ratings  in  Navy 
personnel  offices  is  devoted  to  data  input  to  M&PMI5 
and  JUMPS  ('lichna,  Laidlaw,  and  Obermayer,  1978). 

In  addition  to  the  investment  of  large  amounts  of 
personnel  hours,  Obermayer  (1977)  cites  two  other 
critical  problem  areas.  These  include  significant 
error  rates  (10-30%)  and  long  delays  (70-90  days)  in 
updating  personnel  information  entered  by  hand-typed 
optical  character  recognition  forms  (OCR).  Significant 
improvements  in  all  of  these  areas  are  feasible  through 
various  office  automation  procedures  involving  direct 
human/computer  interface.  Care,  however,  must  be  taken 
to  consider  appropriate  human  engineering  design 
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principles  to  optimize  the  human/computer  communication 
interface.  The  magnitude  of  this  design  problem  w as 
recently  underscored  by  a  GAO  report  (1980)  which 
evaluated  various  inefficiencies  in  the  Navy's 
computerized  pay  system. 


Background 


Even  though  the  fundamental  concept  of  an 
interactive  system  requires  a  continual  interaction 
between  the  human  and  the  computer,  few  data  exist  on 
the  operation  of  the  system  hardware  and  operator 
behavior.  Although  each  system  is  somewhat  unique,  any 
on-line  interaction  with  time-sharing  systems  involves 
several  factors.  Carbonell,  Elxind,  and  Nickerson 


(1968)  discussed  the  parameters  of  accessibility  and 
response  time.  Accessibility  is  the  ability  of  the 
user  to  enter  the  time-sharing  system  and  is  a  function 
of  the  current  load.  Clearly,  the  ideal  situation 
would  be  a  time-sharing  system  that  is  always 
accessible  when  the  user  wants  it.  But,  this  ideal 


state  is  often  not  realized  and  no  data  exist  on  the 


effect  of  limited  accessibility  on  user  rates. 

Response  time,  on  the  other  hand,  is  the  amount  of 


time  required  by  the  system  to  respond  to  a  user  input 
and  depends  on  a  variety  of  factors  including  the 
current  number  of  users,  the  complexity  of  the 
calculation  necessitated  by  the  user  input,  and  the 
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hardware  configuration  of  the  system.  If  the  response 
time  of  an  interactive  system  is  not  adequate,  the 
human's  performance  may  deteriorate.  Obviously,  there 
is  no  one  optimum  response  time  that  pertains  to  all 
time-snaring  situations.  In  fact,  Engel  and  Granda 
(1975)  present  guidelines  ranging  from  0.1  seconds  to 
60  seconds  maximum  acceptable  response  time  depending 
upon  the  system  recognized  activity  (e.g.,  key 
response,  file  update,  error  feedback)  and  user 
activity  (e.g.,  system  activation,  loading  and 
restart) .  Generally,  the  recommended  guideline  for 
system  acknowledgment  that  a  request  is  being  processed 
is  an  almost  instantaneous  response  time  i.e.,  <0.5 
seconds).  miller  (1968),  for  example,  recommends  that 
all  other  human/computer  interactions  should  have  less 
than  a  2  second  response  time  unless  the  operator  is 
engaged  in  the  particular  terminal  operation  only 
infrequently. 

Actual  behavioral  data  of  the  effect  of  system 
response  time  are  quite  limited.  Morfield,  Wiesen, 
Grossberg,  and  Yntema  (1969)  studied  the  effect  of 
response  times  varying  from  1  second  to  100  seconds  on 
user  problem  solving  performance.  Average  time  to 
completion  increased  as  expected,  but  net  completion 
time  also  increased  which  suggested  that  the  operator 
was  becoming  distracted.  Additional  research  by 
Grossberg,  Wiesen,  and  Yntema  (1976)  introduced  unknown 
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variability  into  the  various  response  times.  This 
research  showed  that  although  users  made  fewer 
inquiries  of  the  time-sharing  systems  with  longer 
system  response  times,  system  delays  did  not  affect 
their  actual  time  to  solution. 

One  particularly  critical  issue  relating  to  the 
effects  of  system  response  on  operator  performance  is 
that  much  of  the  previous  research  is  not  directed 
toward  true  system-related  variables  manipulated  within 
realistic  operational  ranges.  Tne  current  data 
collection  effort  on  this  project  provided  some 
meaningful  information  in  this  regard.  Specifically, 
variables  such  as  the  display  rate,  delays  in 
displaying  echoing  of  keyboard  inputs,  and  the  design 
variables  that  vary  quite  markedly  in  existing  time¬ 
sharing  systems.  Essentially  no  data  are  available  on 
the  separate  and  combined  effects  of  these  variables  on 
operator  behavior.  System  and  display  design  decisions 
are  constantly  being  made  devoid  of  these  data  even 
though  the  human  operator  is  the  ultimate  user  of  the 
interactive  system. 

A  preliminary  study  by  Beatty  and  Williges  (1980) 
provided  the  background  data  for  the  current  study. 
Their  results  suggested  that  embedded  measures  of  the 
operator's  data  entry  performance  can  be  used  as 
powerful  tools  in  measuring  the  human/computer 
interface.  In  this  regard,  both  user  ready  time  and 
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system  response  times  need  to  be  evaluated  in 
complicated  tasks  involving  personnel  transactions. 

&  more  comprehensive  approach  is  needed  where  a 
variety  o f  actual  system,  task,  operator,  and 
environment  independent  variables  are  manipulated 
together  and  their  functional  relationship  to 
operator/analyst  performance  is  described.  With  the 
inherent  automatic  data  recording  capabilities  of 
computer-based  systems,  this  approach  seems  feasible. 
Finkelman,  Wolf,  and  Friend  (1977)  offer  polynomial 
regression  as  a  reasonable  method  to  define  such 
functional  relationships  for  data  characterized  by 
lower-order  trends.  A  polynomial  expression  provides  a 
convenient  approximation  to  a  variety  of  mathematical 
relationships  tnereby  making  it  a  powerful  tool  for 
predicting  operator  performance  while  still  using  a 
standard  format.  The  general  form  of  such  a  second- 
order  polynomial  model  would  be, 

y  =  e0  +  !  +  I  Vixi  +  T  S  Wixj  +  c'  (1) 

i=l  i=l  i=l  j=i+l 

where  human  behavior  Y,  is  expressed  in  terms  of  an 

intercept  value  ,  and  the  weighted  linear 

combinations  of  first-order  terms, X^  ,  pure  quadratic 

2 

second-order  terms,  ,  and  linaar  interaction, 

second-order  terms,  X^X4  ,  of  the  k  system  variables 
stated  in  terms  of  x^s .  The  value  c  is  the  estimate  of 
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error  in  prediction.  Sample  estimates,  b,  of  the 
various  8  parameters  are  readily  obtained  through 
standard  least  square  regression  procedures. 

Recently,  Williges  (1977)  suggested  that  this 
polynomial  regression  approach  Mould  be  useful  in 
developing  an  automated  assessment  scheme  of  personnel 
performance  in  computer-based  systems.  This 
performance  scheme,  in  turn,  could  be  used  for  embedded 
performance  measurement,  evolutionary  system  operation, 
performance  enhancement  procedures,  and  the  development 
of  realistic  data  bases  from  which  theoretical 
extrapolations  can  be  made  to  the  design  of  future 
human/computer  systems. 

In  addition  to  specifying  the  system  parameters 
(X^'s)  in  Equation  1,  one  must  also  determine  the 
appropriate  human  behavior  (Y) .  The  embedded 
performance  assessment  discussed  by  Williges  (1977) 
potentially  involves  a  variety  of  measures  dealing  with 
time  to  complete  a  task,  operator  waiting  times,  error 
rates,  etc.  which  can  be  automatically  recorded  by  the 
computer  system  while  the  operator  is  using  the 
interactive  terminal.  But,  embedded  performance 
measures  are  only  one  class  of  metrics  that  can  be  used 
to  evaluate  the  overall  human/computer  interface. 
Other  classes  of  metrics  include  the  human  operator's 
subjective  ratings  of  satisfaction  with  the  system 
configuration  and  work  sampling  measures  estimating  the 
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proportion  of  time  spent  in  various  aspects  of  the 
interactive  human/computer  task.  Each  of  these  two 
metrics  classes  have  been  used  only  to  a  limited  extent 
in  evaluating  operator  behavior  in  interactive  systems 
(See,  for  example.  Miller,  1977;  and  Hoecker  and  Pew, 
1979)  . 


Objective 

The  purpose  of  this  study  is  to  demonstrate  the 
utility  of  incorporating  all  three  classes  of  metrics 
in  evaluating  human/computer  interactions.  Each  class 
of  measures  was  used  separately  in  generating 
functional  relationships  between  human  behavior  and 
four  systems  parameters ;  the  resulting  functional 
relationships  were  integrated  in  a  multivariate 
analysis  to  provide  an  overall  description  of  the 
human/computer  interface. 
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Experimental  Task 

Personnel  Records  Task 

The  general  task  environment  was  structured  around  a  Navy 
personnel  records  task  in  which  the  operator  was  required  to  use 
an  interactive  computer  terminal  to  perform  specified 
transactions  on  simulated  personnel  records.  The  particular 
transaction  used  in  this  study  was  a  form-filling  task  analogous 
to  a  pay  order  form  used  to  issue  a  temporary  pay  change  for  a 
given  individual.  Figure  1  depicts  the  display  layout  of  the  pay 
order  form  as  used  in  this  study.  Alphanumeric  information  was 
entered  into  a  series  of  twelve  fields  designated  on  the  display 
as  shown  in  Figure  1.  The  cursor  symbol  (>)  shown  at  the  bottom 
of  Figure  1  designated  a  working  area  of  the  display  used  for 
query  language  commands.  When  data  were  entered  in  any  field, 
the  cursor  was  first  moved  to  that  field  to  activate  the  area. 
These  fields  included  information  items  such  as  date,  name, 
social  security  number,  duty  station,  amount  of  pay,  reason  for 
change,  etc.  Specific  Navy  format  rules  were  followed  for 
entering  the  date,  name,  and  times  in  the  appropriate  fields  on 
the  interactive  terminal.  Even  though  all  records  used  in  this 
experiment  were  simulated,  they  did  represent  the  type  of 
information  and  formatting  rules  used  in  actual  Navy  personnel 
records . 
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Bach  subject  was  required  to  perform  either  ADD  or  CHANGE 
transactions  on  these  records.  The  ADD  command  was  used  to  add 
new  records  to  the  system,  whereas  the  CHANGE  command  was  used  to 
modify  existing  personnel  records.  All  information  pertaining  to 
the  revision  and  addition  to  records  was  presented  on  an  adjacent 
plasma  panel  via  a  PLATO  IV  terminal  (3itzer  and  Johnson,  1971) 
connected  to  the  University  of  Illinois  PLATO  system.  The 
presentation  of  these  ADD  and  CHANGE  requests  was  either 
structured  according  to  the  format  used  on  the  form-filling 
interactive  display  or  unstructured  in  a  free  flowing  text 
format. 

The  arrangement  of  the  terminal  work  area  closely  followed 
the  procedures  reported  by  Beatty  and  Williges  (1980) .  Figure  2 
shows  this  arrangement  which  consisted  of  two  side-by-side  plasma 
panels.  The  plasma  panel  on  the  right  side  was  the  PLATO  IV 
terminal  used  for  instructions  as  well  as  the  ADD  and  CHANGE 
requests  during  data  entry  in  the  actual  experimental  trials. 
The  left-hand  terminal  was  a  special  purpose  plasma  panel 
developed  by  Information  Technology  Limited  (ITL)  which  was  used 
for  data  entry  in  the  experiment.  This  display  projected  the  pay 
order  form  shown  in  Figure  1  and  was  used  interactively  by  the 
subjects  in  the  form-filling  task.  A  one-way  communication 
channel  existed  between  the  ITL  plasma  panel  and  the  PLATO  IV 
terminal  which  called  the  next  data  entry  request  to  be  performed 
at  the  completion  of  the  preceding  request. 


ITL 

KEYBOARD 

POSITIONS 


EXPERIMENTER'S  CHAIR 
SUBJECT'S  CHAIR 


LIGHT  SOURCE 


Figure  2.  Arrangement  of  the  interactive  computer  terminals 
used  in  the  data  entry  task. 
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Generic  Task  Simulation 

To  facilitate  the  experimental  evaluation  of  automated 
performance  assessment  in  a  personnel  records  task,  a  generic, 
single-operator,  event-based  task  simulation  was  developed.  The 
hardware  for  this  system  is  a  512  x  512  parallel-plasma  panel 
interfaced  directly  to  a  laboratory  PDP  11/5"  .iiinicomputer .  The 
parallel  display  panel  is  equipped  with  both  a  32  x  32  touch 
panel  entry  and  a  keyboard  input  capability  to  the  PDP  11/55 
computer.  The  computer  stores  the  simulated  personnel  records 
for  the  performance  assessment  task,  interprets  queries  made  by 
the  subject  during  personnel  records  transactions,  and  records 
the  subject's  task  performance  in  terms  of  errors  and  response 
latencies.  These  performance  measures,  in  turn,  are  used  as  the 
dependent  measures  in  the  performance  assessment  profiles. 

Two  general  software  routines  were  programmed  in  connection 
with  the  generic  task  simulation.  One  routine  allows  for  general 
purpose  communication  between  the  PDP  11/55  computer  and  the 
paral lel-plasma  panel.  This  set  of  assembly  language  routines 
enables  one  to  write  a  variety  of  alphanumeric  characters  on  the 
panel  as  well  as  perform  various  line  drawing  operations.  The 
second  set  of  software  programs  was  developed  to  generate  the 
generic,  event-based  task.  These  programs  produce  a  table  driven 
task  simulation  which  allows  for  such  things  as:  record 
additions/deletions,  record  switching,  page  switching,  field 
switching,  updating,  and  a  primitive  command  language.  Details 
on  the  design  of  this  generic  task  simulation  as  well  as  a 
complete  source  list  of  the  various  subroutines  are  provided  by 
Mason,  Evans,  and  Beatty  (1979)  . 
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Four  undergraduate  students  at  Virginia  Polytechnic 
Institute  and  State  University  were  used  as  subjects  in  this 
experiment.  The  three  male  and  one  female  subjects  received 
$3. 00/hour  for  their  participation.  Each  subject  had  no  previous 
experience  in  making  personnel  transactions  on  a  computer-based 
system . 

Independent  Variables 

Four  parameters  relating  to  various  timing  parameters  of  the 
computer  system  were  manipulated.  These  variables  included 
system  delay  (3D),  display  rata  (DR),  echo  rate  (ER) ,  and  buffer 
length  (BL) .  Levels  of  each  of  these  independent  variables  were 
set  according  to  results  of  pretest  data,  effective  ranges  noted 
in  the  scientific  literature,  and  realistic  ranges  encountered  in 
interactive  system  operation. 

The  SD  variable  controlled  the  delay  time  (in  seconds) 
between  an  operator's  input  command  (e.g.,  search  files,  next 
field,  etc.)  and  the  computer  executions  of  that  command 
signified  by  returning  control  to  the  operator.  The  DR  variable 
manipulated  the  rate  (in  characters/second)  at  which  characters 
were  displayed  on  the  screen  and  was  somewhat  analogous  to  baud 
rate  character istics  of  standard  terminals.  The  last  two  factors 
were  both  related  to  keyboard  entry  timing.  ER  represented  the 
delay  time  (in  seconds)  between  a  keystroke  and  the  appearance  of 
that  character  on  the  display  screen.  BL  referred  to  the  number 


of  characters  typed  on  the  keyboard  that  could  be  held  in  a 
buffer  memory  awaiting  display  on  the  interactive  plasma  panel. 


independent  variables  shown  in  Table  1.  (See  Williges,  1980,  for 
a  detailed  description  of  the  development  and  use  of  central- 
composite  designs  in  behavioral  research.)  The  linear 
transformation  between  the  coded  values  of  the  central-composite 
design  and  the  real-world  values  of  the  four  systems  variables 
are  summarized  in  Table  2. 


Each  subject  received  four  trials  on  each  of  the  resulting 
25  treatment  combinations  thereby  yielding  a  wi thin-subject 
design.  The  four  trials  consisted  of  a  one-half  fractional 
replicate  of  the  combination  of  prompting  tone  (on  or  off),  trial 
presentation  (structured  or  unstructured  information) ,  and  task 


type  (adding  a  record  or  changing  an  existing  record).  The 
third-order  interaction  was  used  as  the  defining  contrast  in 
choosing  the  one-half  replicate  such  that  two  subjects  received 
one  of  the  resulting  replicates  and  the  other  two  subjects 
received  the  other  replicate. 


Procedures 

Each  subject  received  a  computer-assisted  instruction  lesson 
on  the  PLATO  terminal  before  participating  in  the  experiment. 
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Table  1 

Coded  Values  of  Unique  Treatment  Combinations; 
A  Four  Factor  Central  Composite  Design 


Treatment 

Condition 


System 

Dala 


Independent  Variables 


Display 

Rate 


Echo 

Rate 


Buffer 

Length 


+  1.414 

0 

0 

0 

-1.414 

0 

0 

0 

0 

+1.414 

0 

0 

0 

-1.414 

0 

0 

0 

0 

+1.414 

0 

0 

0 

-1.414 

0 

0 

0 

0 

+1.414 

0 

0 

0 

-1.414 

0 

0 

0 

0 

Table  2 

Linear  Transformations  Between  Coded  Values 
Used  in  the  Central-Composite  Design  and  Real 


Wo  r  1  d 

Levels  of 

the  Four 

System 

Variables 

- 

Levels  of 

the  Four 

Independent  Variables 

| 

-1.414 

-1 

0 

+1  +1.414 

System  Delay  (3D) 

0.10 

1.55 

5.05 

8.55  10.00 

Display  Rate  (DR) 

240 

206 

125 

44  10 

|  Echo  Rate  (ER) 

0.00 

0.22 

0.75 

1.28  1.50 

*  Suffer  Length  (BL) 

1 

2 

4 

6  7 

This  lesson  lasted  approximately  45  minutes  and  provided  general 
instruction  on  the  interactive  display  used  in  the  experimental 
sessions  as  well  as  the  rules  Cor  listing  names,  dates,  and 
times . 

Following  the  practice  session,  each  subject  participated  in 
five  experimental  sessions  each  consisting  of  four  trials  on  five 
treatment  combinations.  The  five  treatment  combinations  were 
chosen  randomly  for  each  subject.  Consequently,  each  subject  was 
required  to  complete  100  personnel  records  throughout  the  course 
of  the  experiment.  In  addition,  each  subject  received  four 
practice  trials  in  the  first  experimental  session  to  become 
familiar  with  the  experimental  protocal .  These  four  practice 
trials  included  the  +1.414  levels  of  all  factors  on  two  trials 
and  the  -1.414  levels  of  all  factors  on  the  other  two  trials, 
thereby  showing  each  subject  the  possible  range  of  treatment 
cond i tions . 

Dependent  Variables 

Three  general  classes  of  dependent  variables  were  measured 
in  this  study.  These  classes  included  work  sampling,  embedded 
performance  assessment,  and  operator  satisfaction  ratings.  As 
shown  in  Table  3,  several  specific  measures  were  collected  within 
each  of  these  general  categories  to  provide  a  total  of  22 
dependent  variables. 
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Table  3 

Classes  of  Dependent  Variables  Used  in  the 

Components  Analysis 

Work  Sampling 

Looking  at  Information  (INF) 

Looking  at  Display  (DSP) 

Looking  at  Keyboard  (KBD) 

Information/Typing  (INF/TYP) 

Display/Typing  (DSP/TVP) 

Keyboard/Typing  (KBQ/Typ) 

Embedded  Performance  Assessment 
Typing  Rate  (TRATE) 

Field  Entry/Jsar  Response  Time  (FE/URT) 

Next  Field/User  Response  Time  (NF/URT) 

Field  Entry/Ready  Time  (FE/RT) 

Next  Field/Ready  Time  (NF/RT) 

Ready  Responses  (RDRSP) 

Character  Erasures  (CHER) 

Checking  Time  (CKT) 

Satisfaction  Ratings 

Tone  Rating  ( TONR) 

System  Delay  Rating  (SDR) 

Display  Rate  Rating  (DSPR) 

Echo  Rate  Rating  (ERR) 

Buffer  Length  Rating  (BLR) 

Speed  Rating  (SPEED) 

Accuracy  Rating  (ACCUR) 

Overall  Rating  (OVER) 


Work  Sampling 

rhoughout  the  entire  experimental  session  a  closed-circuit 
television  system  was  used  to  monitor  the  time  spent  by  each 
subject  on  various  aspects  of  the  personnel  transcription  task. 
The  overall  task  was  divided  into  six  mutually  exclusive 
components.  Three  of  these  components  dealt  with  viewing 
information  on  either  the  PLATO  terminal  (INF) ,  the  interactive 
plasma  panel  display  used  in  the  data  entry  task  (DSP)  or  the 
data  entry  keyboard  (KBD) .  The  other  three  components  were 
concerned  with  typing  (data  entries  while  viewing  either  the 
input  information  ( INF/TYP) ,  the  interactive  display  (DSP/TYP) , 
or  the  keyboard  (KBD/TYP) .  Random  observations  were  made 
throughout  the  experimental  session  to  obtain  estimates  of  he 
portion  of  task  time  devoted  to  each  of  these  six  categories. 
The  mean  duration  between  samples  was  5  seconds,  and  the  possible 
durations  randomly  sampled  was  3,  4,  5,  6,  and  7  seconds, 
respectively . 

Embedded  Performance  Measures 

The  generic  task  simulation  allowed  for  on-line  data 
collection  of  several  aspects  of  operator  performance  while  using 
the  interactive  terminal.  Specifically,  the  metering  included  a 
complete  transcription  of  keystroke  inputs,  command  type,  and  a 
variety  of  performance  measures.  User  times  were  separated  into 
response  time,  which  referred  to  the  elapsed  time  from  a  computer 
prompt  to  a  keystroke  input,  and  ready  time,  which  is  the  time  a 
user  is  ready  to  make  an  input  but  the  computer  is  unable  to 
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respond.  The  eight  embedded  performance  measures  used  in  this 
jtudy  included  the  operator's  typing  rate  (IRATE),  the  user's 
response  time  for  making  a  field  entry  (FE/URT)  or  for  selecting 
the  next  field  (NF/URf) ,  the  user's  ready  time  before  a  field 
entry  (FE/RT)  or  next  field  (NF/RT) ,  the  number  of  ready 
responses  (RDRSP)  the  number  of  character  erasures  (CHER) ,  and 
the  checking  time  (CKT)  needed  to  ascertain  that  the  correct 
record  rfss  chosen  from  the  database. 


Satisfaction  Ratings 


The  two  practice  trials  during  the  first  experimental 
session  served  as  a  means  of  anchoring  the  subject's  satisfaction 
rating.  Following  each  set  of  four  trials  on  a  particular 
treatment  combination,  each  subject  was  required  to  complete  a  10 


point,  Likert-type  rating  scale  evaluating  the  prompting  tone 
(TONR) ,  each  of  the  four  independent  variables  (SDR,  DSPR,  ERR, 
BLR),  and  operator  satisfaction  of  the  systems  variables  on  speed 
(SPEED),  accuracy  (ACCUR) ,  and  overall  performance  (OVER).  The 
complete  list  of  questions  used  in  the  rating  scale  is  provided 


in  Appendix  A. 


RESULTS  AND  DISCUSSION 


Both  univariate  and  multivariate  analyses  were  conducted  on 
the  22  dependent  variables  shown  in  Table  3.  The  results  of  each 
set  of  these  analyses  are  presented  separately. 

Univariate  Analyses 

Before  evaluating  the  various  effects  of  the  system  timing 
variables  manipulated  in  this  study,  a  preliminary  analysis  was 
conducted  on  the  fractional  replication  of  the  three  control 
variables  used  to  construct  the  data  entry  task,  i.e.,  the 
alerting  tone,  the  structuring  of  the  information,  and  the  entry 
task  type.  Essentially,  there  were  no  significant  differences 
(£>.05)  between  ADD  or  CHANGE  tasks  and  the  interactions  of  these 
control  variables  with  the  system  timing  variables.  Overall, 
however,  the  presence  of  the  tone  and  the  structuring  of  the 
information  presented  to  the  subjects  had  significant  effects 
(£< .01)  on  the  percent  of  time  spent  viewing  the  display  as  well 
as  user  response  times  during  data  entry.  Specifically,  the 
alerting  tone  increased  the  amount  of  time  spent  viewing  the 
information  display  and  decreased  both  next  field  and  field  entry 
user  response  time.  And,  as  expected,  the  unstructured  trials 
caused  subjects  to  spend  more  time  viewing  the  information  and 
increased  the  field  entry  user  response  times.  Since  the  control 
variables  only  had  these  overall  effects,  the  trials  were 
combined  for  the  subsequent  univariate  and  multivariate  analyses. 


The  overall  analysis  pertains  to  the  three  metrics  of 
satisfaction  ratings,  work  sampling,  and  embedded  performance 
measures.  In  each  dependent  variable  category,  second-order 
polynomial  regression  equations  were  calculated  to  determine  the 
functional  relationship  between  a  specific  dependent  variable  and 
the  four  system  timing  variables  manipulated  in  this  experiment. 
Standard  least  square  regression  procedures  were  used  to  fit 
these  polynomial  expressions.  Subsequently,  an  analysis  of 
variance  was  conducted  on  each  regression  analysis  to  isolate  the 
statistically  significant  predictors.  Comparisons  among  the 
different  metrics,  therefore,  can  be  made  directly  in  terms  of 
the  differential  characteristics  of  the  various  polynomial 
regression  equations.  In  addition,  a  second-order,  orthogonal 
design  was  used  so  that  the  partial  regression  weights  based  on 
coded  data  would  be  uncorrelated  thereby  facilitating  the 
interpretation  of  these  relative  comparisons. 

A  complete  summary  of  each  of  the  separate  polynomial 
regression  equations  as  well  as  the  subsequent  analysis  of 
variance  are  presented  in  Appendix  B.  A  listing  of  the 
significant  predictors  of  each  of  these  polynomial  regressions  is 
presented  in  Table  4  for  easy  reference.  The  interpretation  and 
discussion  of  each  of  these  analyses  is  presented  separately  by 
class  of  metric. 

Work  Sampling 

System  timing  variables  affect  the  amount  of  time  devoted  to 
various  aspects  of  the  task.  Overall,  Figure  3  shows  that 
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Table  4 

Summary  of  Polynomial  Regression  Analysis 
of  Variance  for  Separate  Dependent  Variables 


Metric 

R2 

Significant  Predictors  (p<.01) 

Work  Sampling 

INF 

.044 

- 

DSP 

.362 

ER.  SD,  DR2,  ERXSD 

KBQ 

.076 

3D2 

INF/TYP 

.081 

3D 

DSP/TYP 

.091 

ER 

KBD/TYP 

.341 

ER,  SD,  ERXSD 

II 

added  Performance  Assessment 

TRATE 

.613 

BL,  ER.  ER2,  BLxER,  ERxDR 

SD,  SD2 

FE/URT 

.253 

NF/URT 

.082 

SD  , 

FE/RT 

.456 

sd,  sd; 

NF/RT 

.418 

SD,  3D2 

RDR3P 

.357 

SD 

CHER 

.063 

ER 

CKT 

.067 

DR 

Satisfaction  Ratings 

TONR 

.115 

ER 

SDR 

.530 

ER,  SD,  SD2,  ERXDR 

DSPR 

.141 

DR.  SD,  BL2 ,  ER2,  BLxDR 

ERR 

.510 

ER,  SD,  ER2  SD2 

BLR 

.455 

ER,  SD,  BL‘,  ER2,  SD2 ,  BLxER 

SPEED 

.586 

ER,  SD,  ER2  3D2,  ERxSD 

ACCOR 

.464 

ER,  SD,  ER2,  SD2,  ERxSD 

ER,  DR,  SD,  ER2,  SD2,  ERxDR,  ERxSD 

OVER 

.519 

22 
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operators  spent  significantly  different  (£<.01)  amounts  of  time 
in  various  aspects  of  the  personnel  transaction  task.  The  two 
largest  proportions  of  time  were  spent  in  viewing  the  interactive 
display  (DSP),  and  viewing  the  keyboard  while  entering  data 
(KBD/TYP) .  These  proportions  were  .26  and  .29,  respectively,  of 
the  total  time. 

Subsequent  polynomial  regressions  of  the  time  spent  in 
various  aspects  of  the  task  as  a  function  of  system  timing 
variables  showed  high  multiple  correlations  for  both  DSP  and 
KBD/TYP  (i.e.,  R2=.36  and  R2=.34,  respectively).  In  both 
polynomial  regressions  the  SD  and  ER  variables  were  the  primary 
predictors  of  work  sampling  time  as  shown  in  Table  4,  but  the 
effects  of  these  two  variables  were  quite  dissimiliar.  To  aid  in 
interpreting  these  differential  effects,  the  complete  second- 
order  polynomial  function  as  well  as  a  transect  plot  of  DSP  and 
KBD/TYP  performance  as  a  function  of  the  two  significant  factors 
SD  and  ER  are  shown  in  Figures  4  and  5,  respectively.  The  other 
two  system  variables  are  held  constant  at  the  0  coding  level. 
(Note  that  the  plots  represent  second-order  functions  and  the 
minor  perturbations  shown  in  the  figures  are  merely  artifacts  of 
the  particular  nearest  neighbor  algorithm  used  for  creating  the 
plots  and  the  location  of  predicted  data  points  across  the 
surface.) 

Figure  4  shows  that  the  operator  is  spending  increasingly 
more  time  viewing  the  interactive  display  as  SD  and  ER  increase. 
This  additional  viewing  time  is  necessary  both  to  cross-check 
echoing  of  a  typed  character  and  to  look  for  the  computer  prompt 
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LOOKING  AT  DISPLAY  (DSP) 


DSP  -  0.2371  +  0.0017BL  +  0.0261ER  +  0.0028DR 

+  0.0831SD  -  0.0005BL2  +  0.0015ER2  +  0.0288DR2 
+  0.0039SD2  +  0. 0101BL*ER  -  0.0135BL*DR 

-  0. 0025BL*SD  +  0.0041ER*DR  -  0.0210ER*SD 

-  0. 0054DR*SD 

R2  -  .361 


Figure  4.  Response  surface  for  looking  at  display  as  affected 
by  echo  rate  and  system  delay. 


KEYBOARD/TYPING  (KBD/TYP) 


KBD/TYP  -  0.2751  +  0.0057BL  -  0.0558ER  +  0.0019DR 

-  0.0768SD  -  0.0020BL2  +  0.0114ER2  +  0.0123DR2 

-  0.0134SD2  -  0. 0121BL*ER  -  0.0001BL*DR 

+  0.015 3BL*SD  -  0. 0069ER*DR  +  0.0233ER*SD 
+  0. 0045DR*SD 

R2  -  .341 


Figure  5.  Response  surface  for  keyboard/typing  as  affected 
by  echo  rate  and  system  delay. 


signifying  computer  availability  for  the  next  command  input. 
Results  from  the  K3D/TKP  prediction  equation,  as  depicted  in 
Figure  5,  show  opposite  effects.  Namely,  the  operator  spends 
more  time  viewing  the  keyboard  and  typing  when  SD  and  ER  are 
short,  thereby  allowing  more  immediate  access  to  the  computer. 
Additionally,  Figure  5  shows  that  the  proportion  of  time  spent  on 
KBD/TtfP  decreases  rapidly  in  a  non-linear  fashion  as  SD  and  ER 
increase . 

Embedded  Performance  Assessment 

The  summary  of  the  eight  measures  of  operator  performance 
measures  provided  in  Table  4  show  that  all  the  system  timing 
variables  had  a  significant  (£<.01)  effect  on  operator 
performance  with  at  least  one  dependent  variable.  The  dependent 
variable  with  the  highest  multiple  correlation  in  the  regression 
analysis  was  TRATE  rate  (R2=.61) .  Two  other  regression  analyses 
dealing  with  operator  ready  times  (FE/RT  and  NF/RT)  also  yielded 
high  multiple  correlations  (R^=.46  and  .42,  respectively.  In  the 
user  ready  time  analyses,  the  SD  independent  variable  was  the 
primary  predictor  showing  that  operator  ready  time  increased  as 
system  delay  time  increased. 

The  typing  rate  analysis,  however,  resulted  in  no 
significant  (£<.05)  effect  due  to  3D.  Alternatively,  BL  rather 
than  3D  combined  with  ER  as  the  primary  significant  predictors 
(£<.01).  The  resulting  perspective  response  surface  of  BL  and  ER 
effects  on  operator  typing  rate  is  shown  in  Figure  6.  Typing 
rates  are  quite  low  when  only  one  character  is  held  in  the 
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typing  rate  (TRATE) 


TRATE  «  0.020  +  0.000BL  -  0.007ER  +  O.OOODR 

-  O.OOOSD  -  0.000BL2  +  0.001ER  -  O.OOODR 

+  O.OOOSD2  +  0. 001BL*ER  -  0.000BL*DR 

-  0. OOOBL*SD  -  0. 001£R*DR  -  O.OOOER*SD 

-  0. 000DR*SD 

R2  -  .613 


Figure  6 . 


Response  surface  for  typing  rate  as  affected  by 
echo  rate  and  system  delay. 


keyboard  buffer  and  echo  rates  of  typed  characters  are  delayed  by 
1.50  seconds.  In  this  situation  the  operator  can  quickly 
overtype  the  keyboard  buffer  due  to  the  long  echo  delays  with  the 
result  that  the  character  is  never  entered  into  the  computer.  It 
appears  that  this  particular  combination  of  system  variables 
forces  operators  to  slow  their  input  rates  to  match  the  slower 
computer  system  character i st ics .  The  results  shown  in  Figure  6 
also  suggest  that  the  short  buffer  length  can  be  compensated  for 
easily  by  short  echo  delays,  but  a  larger  buffer  length  does  not 
compensate  for  long  echo  delays  to  any  great  extent. 

Satisfaction  Ratings 

The  third  category  of  metrics  summarized  in  Table  4  deal 
with  various  measures  of  operator  satisfaction.  Ratings  of 
satisfaction  with  the  separate  timing  variables  reflected 
significant  predictors  of  each  of  those  factors  in  the  polynomial 
regression.  The  more  important  rating  scales,  however,  dealt 
with  SPEED ,  ACCUR,  and  OVER.  Surprisingly,  these  three  ratings 
were  highly  correlated  and  resulted  in  essentially  the  same 
functional  relationship  relating  the  systems  variables.  Namely, 
the  significant  (£<.01)  partial  regression  weights  include  both 
first-  and  second-order  effects  of  system  delay  and  keyboard  echo 

rate  (i.e.,  SD,  ER,  3D2,  ER2,  and  SD*ER) . 

* 

To  summarize  this  effect,  the  polynomial  regression  and 
transect  plot  of  the  operator's  overall  rating  of  satisfaction  as 
a  function  of  the  two  significant  factors  SD  and  ER  are  shown  in 
Figure  7.  The  other  two  system  variables  are  held  constant  at 
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the  0  coding  level.  Clearly,  the 
rating)  with  the  fastest  SD  and 
decreased  rapidly  as  timing  delays 
Figure  7  shows  a  flat  plateau  of 
when  SD  was  greater  than  5  seconds 
seconds  delayed. 


subjects  were  satisfied  (high 
Eft ,  but  their  satisfaction 
were  introduced.  In  fact, 
almost  total  dissatisfaction 
and  ER  was  more  than  0.75 


Multivariate  Analyses 

Rather  than  consider  each  of  the  dependent  variables 
separately,  one  can  consider  combinations  of  these  measures  which 
define  necessary  and  sufficient  metric  classes  needed  to  describe 
human/computer  interactions.  For  example,  the  three  general 
metrics  used  in  the  univariate  analyses  are  quite  distinct  as 
measurement  categories,  but  may  not  be  totally  distinct  in  terms 
of  behavioral  dimensions.  Subsequent  multivariate  analyses  were 
conducted  in  an  attempt  to  isolate  these  underlying  behavioral 
dimensions.  First,  a  principal  component  analysis  was  conducted 
to  cluster  the  metrics.  The  resulting  dimension  score  from  the 
principal  components  analysis  was  then  used  as  the  dependent 
variable  in  a  subsequent  polynomial  regression  analysis  to 
evaluate  the  functional  relationship  between  the  system  timing 
variables  and  the  behavioral  dimensions. 


Principal  Components  Analysis 

To  estimate  the  underlying  behavioral  dimensions  a  principal 
components  analysis  was  conducted  on  twenty-one  of  the  dependent 
variables  shown  in  Table  3.  To  avoid  the  problem  of  colinearity 


30 


OVERALL  RATING  (OVER) 


OVER  =  2.390  +  0.190BL  -  1.774ER  -  0. 305 DR 

-  0.917SD  +  0.005BL2  +  1.068ER2  +  0.256DR2 
+  0.881SD2  +  0. 109BL*ER  -  0. 109BL*DR 

-  0. 029BL*SD  +  0. 328ER*DR  +  0.640ER*SD 
+  0.046DR*SD 

R2  =  .519 


Figure  7.  Response  surface  for  overall  rating  as  affected 
by  echo  rate  and  system  delay. 


in  the  work  sampling  data,  the  KBD  dependant  variable  which 
represented  the  smallest  percent  of  time  was  eliminated.  The 
dependent  variables  used  were  drawn  from  the  major  independent 
variables  in  each  of  the  three  metric  classes  of  work  sampling, 
embedded  performance  assessment,  and  satisfaction  ratings.  The 
dependent  measures  were  recorded  across  the  four  subjects  on  each 
of  the  four  trials  of  the  resulting  twenty-five  treatment 
combinations  shown  in  Table  1,  thereby  resulting  in  a  21  x  400 
matrix  for  the  principal  components  analysis. 

The  results  of  the  principal  components  analysis  are 
summarized  in  Table  5  which  shows  the  orthogonally  rotated 
dimension  loadings  for  each  of  the  twenty-one  dependent  measures 
across  the  three  principal  components.  These  three  components 
together  account  for  51.1%  of  the  variance.  If  additional 
dimensions  are  added  beyond  these  three,  the  percent  contribution 
drops  markedly.  Consequently,  the  three  dimensions  shown  in 
Table  4  seem  to  describe  the  clustering  most  parsimoniously. 
These  three  clusters  seam  to  represent  human/computer  interface 
dimensions  of  operator  production,  waiting,  and  planning 
activities. 

By  using  the  orthogonally  rotated  weighting  matrix, 
interpretation  of  the  principal  components  analysis  is 
facilitated.  As  shown  in  Table  4,  the  first  dimension,  which 
accounts  for  23.5%  of  the  variance,  is  most  heavily  weighted  on 
typing  rate  and  ratings  of  echo  rate,  buffer  length,  speed, 
accuracy,  and  overall  satisfaction.  In  other  words  this 
dimension  appears  to  be  related  to  PRODUCTION  activities  of  the 
operator . 
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Table  5 

Orthogonally  Rotated  Factor  Pattern  of  the 
Principal  Components  Analysis 


rtETRIC 

1 

PRODUCTION 

2 

WAITING 

3 

PLANNING 

INF 

-0.023 

0.271 

0.371 

DSP 

-0.071 

-0.577 

-0.119 

INF/TYP 

0.098 

0.195 

0.092 

D3P/TYP 

-0.155 

-0.127 

-0.549 

KBD/TYP 

0.292 

0.399 

0.337 

TRATE 

0.744 

-0.143 

0.288 

FE/URT 

0.112 

0.273 

-0.599 

NF/URT 

0.087 

0.096 

-0.663 

FE/RT 

-0.117 

-0.870 

0.119 

NF/RT 

-0.069 

-0.873 

0.169 

RDRSP 

-0.033 

-0.751 

0.147 

CHER 

-0.261 

0.132 

0.071 

CHI’ 

0.038 

0.055 

-0.233 

SDR 

0.359 

0.738 

-0.092 

TONR 

0.195 

0.008 

0.759 

DSPR 

0.053 

0.311 

0.382 

ERR 

0.350 

0.151 

0.023 

BLR 

0.734 

0.194 

0.058 

SPEED 

0.863 

0.328 

-0.062 

ACCOR 

0.360 

0.352 

-0.010 

OVER 

0.376 

0.354 

-0.002 

EIGENVALUES 

5.983 

2.798 

1.951 

i  TOTAL  VARIANCE 

23.5% 

13.3% 

9.3% 
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The  second  dimension  accounts  for  13.3%  of  the  variance  and 
appears  to  be  representative  of  the  operator's  WAITING 
activities.  Metrics  such  as  time  spent  viewing  the  display, 
field  entry  and  next  field  ready  times,  operator  ready  responses, 
and  ratings  of  system  delay  weigh  most  heavily  on  the  operator's 
waiting  dimension. 

Although  the  third  dimension  accounts  for  only  9.3%  of  the 
variance,  it  does  appear  to  represent  another  feature  of  the 
human/computer  interface  which  is  separate  from  the  first  two. 
Dependent  variables  including  time  spent  viewing  the  display 
while  typing,  next  field  and  field  entry  user  response  times,  and 
ratings  of  the  cueing  tone  were  the  primary  measures  clustered  on 
this  dimension  which  appears  to  be  related  to  PLANNING 
activities.  Since  the  personnel  records  tasks  used  in  this  study 
was  primarily  a  transcription  task,  one  would  expect  planning 
activities  to  account  for  only  a  small  portion  of  the  operator's 
performance.  In  other  human/computer  tasks,  this  activity  may 
become  much  more  important. 

Multivar iate  Response  Surfaces 

Each  of  the  three  composite  human/computer  interface 
dimensions  (i.e.,  PRODUCTION,  WAITING,  and  PLANNING)  were  used 
separately  to  determine  the  functional  relationships  among  the 
system  timing  variables.  \  weighted  dimension  score  was 
determined  for  each  unrotated  dimension  and  was  used  as  the 
dependent  variable  in  the  polynomial  regression  analysis.  A 
complete  second-order  polynomial  regression  was  calculated  to 
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predict  production,  waiting,  and  planning  activities  as  a 
function  of  the  four  system  timing  variables.  The  results  of 
these  analyses  are  summarized  in  Appendix  C. 

Even  though  each  of  the  three  regressions  had  significant 

predictors,  the  prediction  equations  for  both  PRODUCTION  and 

WAITING  activities  accounted  for  substantially  more  variance  (R2 

of  .523  and  .517,  respectively)  than  the  prediction  of  PLANNING 
•  •  •  2 

activities  (R  *  .162).  Although  comparisons  are  presented  among 
all  three  dimensions  for  completeness,  the  low  multiple 
correlation  coefficient  for  PLANNING  makes  interpretation  of  this 
dimension  somewhat  suspect. 

Linear  and  quadratic  effects  of  system  response  time  and 
keyboard  echo  rates  were  the  primary  predictors  of  PRODUCTION  and 
PLANNING  activities  {£<.001);  whereas,  the  linear  effects  of  all 
four  timing  variables  and  the  quadratic  effect  of  keyboard  echo 
rates  were  the  main  significant  predictors  of  WAITING  activities 
(£<.05).  To  illustrate  the  differential  effects  of  the  system 
timing  variables,  perspective  response  surfaces  of  operator 
production,  waiting,  and  planning  activities  are  shown  in  Figures 
3,  4,  and  5  respectively,  with  buffer  length  and  display  rate 
held  constant  at  the  mean  levels. 

By  comparing  Figures  8,  9,  and  10,  one  can  see  that  system 
delay  and  keyboard  echo  rate  were  important  predictors  of 
operator  activities,  but  these  variables  affected  operator 
behavior  differentially.  Figure  8  shows  production  activity  to 
be  highest  at  the  shortest  system  delay  and  keyboard  echo  rate. 
As  delays  in  either  of  these  two  system  timing  variables 
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WAITING  (W) 

-  0.15  +  0.13BL  -  0.54ER  +  0.08DR  +  0.55SD  -  0.08BL2 
+  0.13ER2  +  0.06 DR2  +  0.07SD2  +  0.04BL*ER  -  0.09BL*DR 

-  0.06BL*SD  -  0. 07ER*DR  +  0.02ER*SD  -  0.04DR*SD 


PLANNING  (PL) 


increase,  production  activity  decreases  markedly.  On  the  other 
hand,  waiting  activities  as  shown  in  Figure  9  are  lowest  when  the 
system  delay  is  shortest  and  keyboard  echo  rate  is  the  longest. 
In  this  case,  the  long  keyboard  echoing  rates  mask  the  system 
response  time  effects  because  the  operators  cannot  make  ready 
responses  quickly.  Other  differences  are  due  to  the  significant 
buffer  length  and  display  rate  effects  which  increase  WAITING 
activities.  Finally,  Figure  10  shows  a  marked  curvilinear  effect 
of  system  delay  such  that  PLANNING  activities  are  reduced  at  an 
intermediate  system  delay  and  increase  at  extremely  slow  and  fast 
system  delays. 

Composite  Multivariate  Surface 

Tradeoffs  among  the  three  multivariate  surfaces  can  be  made 
by  superimposing  the  surfaces  to  form  a  composite  multivariate 
surface.  These  composite  surfaces  can  be  constructed  in  a 
variety  of  ways  depending  upon  the  weightings  chosen  for  the 
separate  surfaces.  Two  of  these  alternatives  are  shown  in  Figure 
11  which  depicts  the  composite  of  PRODUCTION  activities  added  to 
the  inverse  of  WAITING  and  PLANNING  activities.  These  composite 
surfaces  then  represent  combined  throughput  where  the  high  score 
equals  high  PRODUCTION  and  low  WAITING  and  PLANNING  activities. 

Figure  11a  depicts  the  composite  surface  based  on  equal  and 
additive  contributions  of  the  three  separate  activities;  whereas. 
Figure  lib  depicts  a  composite  surface  based  on  differential 
contributions  of  the  three  separate  activities.  Specifically, 
the  differential  contributions  in  Figure  lib  are  determined  by 


10.00 

Figure  11.  Composite  response  surfaces  of  three  multivariate 

dimensions  using  (a)  additive  contributions  and  (b) 
percent  of  variance  accounted  for  by  each  dimension. 
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the  percent  of  variance  accounted  for  by  the  PRODUCTION,  WAITING, 
and  P1ANNING  dimensions  (i.e.,  28.5%,  13.3%,  and  9.3%, 
respectively) .  By  comparing  Figures  11a  and  lib,  one  can  see 
that  these  two  strategies  result  in  slightly  different  composite 
surfaces.  Whan  the  three  activities  are  combined  in  an  additive 
manner  (Figure  11a) ,  the  composite  surface  is  almost  a  rising 
plain  that  is  dominated  by  SD.  On  the  other  hand,  when  the 
composite  surface  is  based  on  percent  of  variance  (Figure  lib) , 
it  then  appears  more  characteristic  of  the  PRODUCTION  activity 
surface  which  is  weighted  most  heavily  in  the  composite. 
Clearly,  one  must  give  careful  consideration  to  the  weighting 
alternatives  in  order  to  generate  the  composite  surface  most 
appropriate  for  a  particular  system  applications. 
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CONCLUSIONS 


Clearly,  all  three  classes  of  metrics  are  needed  to  provide 
a  complete  analysis  of  the  effects  of  the  four  systems  variables 
on  operator  behavior.  By  choosing  any  of  these  metric  classes 
only  part  of  the  description  of  operator  behavior  is  available. 
Not  only  do  different  metric  classes  show  different  functional 
relationships  for  the  same  system  variables,  but  they  also  show 
that  different  system  variables  are  primary  determiners  of 
operator  behavior  in  different  metric  classes.  By  using  these 
three  classes  of  measures  and  representing  the  functional 
relationships  in  terms  of  response  surfaces,  the  system  designer 
can  easily  superimpose  the  various  surfaces  to  make  the  necessary 
human/computer  interface  design  tradeoffs. 

Besides  using  the  separate  dependent  measures  to  determine 
specific  system  design  considerations,  the  multivariate  response 
surfaces  allows  for  a  more  general  interpretation  of  the 
human/computer  interface.  These  multivariate  analyses  represent 
operator  behavior  at  the  human/computer  interface  in  terms  of 
three  major  activities  --  production,  waiting,  and  planning.  In 
the  personnel  records  task  used  in  this  study,  the  planning 
aspect  of  operator  activities  was  not  central  and  accounted  for 
only  a  small  percent  of  variance.  ^ditional  research  is  needed 
to  determine  if  these  same  three  activities  characterize  human 
performance  in  a  variety  of  computer  tasks  with  differential 
weightings  of  these  dimensions  across  tasks. 
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APPENDIX  A 

OPERATOR  SATISFACTION  RATING  SCALE 


A-0 


V 


OPERATOR  SATISFACTION  RATING  SCALE 


DIRECTIONS:  Circle  the  appropriate  response  for  the  "YES"  and 
“NO"  questions. 

1.  TONE 

a.  Did  the  tone  affect  your  performance? 

Yes  No 

b.  Use  a  slash  to  indicate  whether  the  Tone  was  OK, 
Interfering,  or  Helpful. 

+ - f - + - + - + - + - + - + - + - + - + 

INTERFERING  OK  HELPFUL 

2.  SYSTEM  RESPONSE  TIMS 

System  Response  Time  is  the  time  it  takes  the  computer  to 
respond  to  your  commands.  It  is  measured  from  the  time  you 
hit  the  NEXT  key  until  the  time  you  see  the  "command  arrow." 

a.  Did  the  System  Response  Time  affect  your  performance? 

Yes  No 

b.  Use  a  slash  to  indicate  whether  the  System  Response  Time 
was  OK,  Too  Slow,  or  Too  Fast. 

+ - + - f - + - +- - f - + - +• - f - + - + 

TOO  SLOW  OK  TOO  FAST 


3.  DYNAMIC  DISPLAY  RATE 


Dynamic  Display  Rata  is  the  speed  with  which  the  computer 
writes  the  DATA  in  a  field  (such  as  the  Name  Field)  when  you 
retrieve  a  record  from  the  file  (for  example,  on  a  change). 

a.  Did  the  Dynamic  Display  Rate  affect  your  performance? 

Yes  No 

b.  Use  a  slash  to  indicate  whether  the  Dynamic  Display  Rate 
was  OK,  Too  Slow,  or  Too  Fast. 

+ - f - + - + - +• - 4- - + - + - ¥ - +• - + 

TOO  SLOW  OK  TOO  FAST 

4.  KEYSTROKE  ECHO  DELAY 

Keystroke  Echo  Delay  is  the  time  it  takes  the  computer  to 

write  a  character  on  the  display  after  you  have  made  a 
keystroke. 

a.  Did  the  Keystroke  Echo  Delay  affect  your  performance? 

Yes  No 

b.  Use  a  slash  to  indicate  whether  the  Keystroke  Echo  Delay 
was  OK,  Too  Long,  or  Too  Short. 

TOO  LONG  OK  TOO  SHORT 


5.  TYPE  AHEAD  BUFFER  LENGTH 


Type  Ahead  Buffer  Length  is  the  number  of  characters  you  can 
type  ahead  of  what  you  can  see  on  the  display. 

a.  Did  the  length  of  the  Type  Ahead  Buffer  affect  your 

performance? 

Yes  No 

b.  Use  a  slash  to  indicate  whether  the  Type  Ahead  Buffer  was 
OK,  Too  Short,  or  Too  Long. 

+ - + - f - 4- - f - 4- - + - 4. - - + - + 

TOO  SHORT  OK  TOO  LONG 

6.  OPERATOR  SATISFACTION :  SPEED 

Are  you  satisfied  that  the  characteristics  of  this  system  did 
not  slow  down  your  completion  of  the  task? 

+ - + - + - + - f - f - (- - +• - + - + - f 

TOTALLY  UNSATISFIED  TOTALLY  SATISFIED 


THE  SYSTEM  ALWAYS  SLOWED 
DOWN  MY  PERFORMANCE. 


THE  SYSTEM  NEVER  SLOWED 
DOWN  MY  PERFORMANCE. 


7.  OPERATOR  SATISFACTION:  ACCURACY 

Are  you  satisfied  that  the  characteristics  of  this  system  did 
not  decrease  your  accuracy  in  completing  the  task? 

+ - h - + - + - +■ - + - + - <■ - + - + - * 

TOTALLY  UNSATISFIED  TOTALLY  SATISFIED 

THE  SYSTEM  ALWAYS  THE  SYSTEM  NEVER 

DECREASED  MY  ACCURACY.  DECREASED  MY  ACCURACY. 

8.  OPERATOR  SATISFACTION:  OVERALL 

Are  you  satisfied  that  the  characteristics  of  this  system  did 
not  interfere  with  your  overall  performance? 

+ - f - f - + - + - + - f - + - + - + - + 

TOTALLY  UNSATISFIED  TOTALLY  SATISFIED 

THE  SYSTEM  ALWAYS  THE  SYSTEM  NEVER 

DECREASED  MY  PERFORMANCE.  DECREASED  MY  PERFORMANCE. 


A-4 


APPENDIX  B 

ANALYSIS  OP  VARIANCE  SUMMARY  TABLES 
UNIVARIATE  ANALYSES 


B-Q 


Table  B.l 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  INF 


ANOVA  SUMMARY  TABLE 


Source 

df 

S3 

F 

£ 

Regression 

(14) 

0.15550 

1.27 

0.2253 

Buffer  Length  (3L) 

1 

0.00471 

0.54 

0.4639 

Echo  Rate  (ER) 

1 

0.00277 

0.32 

0.5741 

Display  Rate  (DR) 

1 

0.00010 

0.01 

0.9132 

System  Delay  (SD) 

1 

0.01343 

2.10 

0.1479 

BL2 

1 

0.03395 

3.37 

0.0498 

er; 

1 

0.00004 

0.01 

0.9406 

dr; 

1 

0.00005 

0.01 

0.9390 

3D2 

1 

0.02183 

2.49 

0.1154 

8L*ER 

1 

0.00000 

0.00 

0.9877 

8L*DR 

1 

0.01476 

1.68 

0.1952 

8L*3D 

1 

0.04255 

4.85 

0.0292 

ER*DR 

1 

0.00075 

0.09 

0.7699 

ER*3D 

1 

0.01528 

1.74 

0.1875 

OR*SD 

1 

0.00023 

0.03 

0.3710 

Residual 

335 

3.37565 

Total 

399 

3.53115 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


INF  =*  0.1673  +  0.0033BL  -  0.0029ER  -  0.Q005DR 

-  0 .007550-  0.0162BL2  -  0.0006ER2  -  0.0006DR2 
+  0.0130SD2  -  0.000 13L*ER  -  0.0075BL*DR 

-  0.0 1 28BL*3D  +  0.0017ER*DR  -  0.0077ER*SD 

-  0.0009DR*3D 


R2  =*  .044 


B-l 


Tabla  B.2 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  DSP 


ANOVA 

SUMMARY  TABLE 

Source 

df 

ss 

F 

£ 

Regression 

(14) 

2.74673 

15.58 

0.0001 

Buffer  Length  (BL) 

1 

0.00096 

0.08 

0.7817 

Echo  Rate  (ER) 

1 

0.21954 

17.44 

0.0001 

Display  Rate  (DR) 

1 

0.00256 

0.20 

0.6523 

System  Delay  (SO) 

1 

2.21472 

175.91 

0.0001 

1 

0.00003 

0.00 

0.9552 

ER2 

1 

0.00031 

0.03 

0.8742 

DR2 

1 

0.10655 

8.46 

0.0039 

SD2 

1 

0.00203 

0.16 

0.6876 

BL*ER 

1 

0.02625 

2.08 

0.1496 

3L*DR 

1 

0.04696 

3.73 

0.0542 

BL*SD 

1 

0.00168 

0.13 

0.7146 

ER*DR 

1 

0.00446 

0.36 

0.5516 

ER*3D 

1 

0.11290 

8.97 

0.0029 

DR*  3D 

1 

0.00713 

0.61 

0.4341 

Residual 

385 

4.84727 

To  tal 

399 

7.59400 

SECOND 

-ORDER 

POLYNOMIAL  REGRESSION 

DSP  =  0.2371  +  0.0017BL  +  0.0261ER  +  0.0023DR 

+  0.0831SD  -  0.0005BL2  +  0.0015ER2  +  0.0288DR2 
+  0.00393D2  +  0 . 0 1 0 13L*ER  -  0.01353L*DR 

-  0 . 00  25BL*SD  -t-  0.0041ER*DR  -  0.0210ER*SD 

-  0.0054DR*3D 


R2  =  .361 


Table  B.3 


Analysis  o£ 

Variance 

Summary  Table  of  Se 

cond-Drder , 

Polynomial 

Regression  of  KBD 

ANOVA 

SUMMARY  TABLE 

Source 

df 

SS 

F 

E 

Regression 

(14) 

0.03078 

2.26 

0.0057 

Buffer  Length  (BL) 

1 

0.00000 

0.00 

0.9736 

Echo  Rate  (ER) 

1 

0.00073 

0.76 

0.3847 

Display  Rate  (DR) 

1 

0.00377 

3.89 

0.0494 

System  Delay  (3D) 

1 

0.00512 

5.27 

0.0223 

BL2 

1 

0.00063 

0.66 

0.4191 

ER2 

1 

0.00045 

0.47 

0.4955 

DR2 

1 

0.00384 

3.95 

0.0475 

SD* 

1 

0.00374 

8.99 

0.0029 

BL*ER 

1 

0.00272 

2.31 

0.0948 

BL*DR 

1 

0.00442 

4.55 

0.0336 

BL*SD 

1 

0.00023 

0.24 

0.6216 

ER*DR 

1 

0.00003 

0.03 

0.8537 

ER*SD 

1 

0.00002 

0.03 

0.3659 

DR*SD 

1 

0.00001 

0.02 

0.8950 

Residual 

385 

0.37440 

Total 

399 

0.40518 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


KBO  =  0.0231  ¥  .00017BL  -  0.0015ER  -  0.Q034DR 

+•  0.004 030  +  0.0022BL2  -  0.0013ER2  -  0.0054DR2 

-  0.0032SD2  -  0.00  32BL*ER  ¥  0.00413L*DR 

-  0 . 00 09BL*SD  -  0.000 3ER*DR  -  0.0003ER*3D 

-  0.0002DR*3D 


R2  =  .075 


B-3 


Tabla  B.4 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  INF/TYP 


ANOVA  SUMMARY  TABLE 


Source 

df 

SS 

F 

£ 

Regression 

(14) 

0.10757 

2.42 

0.0029 

Buffer  Length 

(3L) 

1 

0.00472 

1.49 

0.2236 

Echo  Rate  <ER) 

1 

0.01213 

3.82 

0.0514 

Display  Rate 

(DR) 

1 

0.00411 

1.30 

0.2556 

System  Delay 

(3D) 

1 

0.03059 

9.63 

0.0021 

BL2 

1 

0.00787 

2.48 

0.1160 

ER2 

1 

0.00325 

1.02 

0.3126 

dr; 

1 

0.01987 

6.26 

0.0128 

sd2 

1 

0.00176 

0.55 

0.4570 

SL*ER 

1 

0.00228 

0.72 

0.3969 

BL*DR 

1 

0.00151 

0.48 

0.4908 

BL*3D 

1 

0.00013 

0.04 

0.8371 

ER*DR 

1 

0.00040 

0.13 

0.7207 

ER*SD 

1 

0.01422 

4.48 

0.0350 

DR*SD 

1 

0.00468 

1.47 

0.2254 

Residual 

385 

1.22301 

Total 

399 

1.33059 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


INF/TYP  =  0.0498  f  0.00333L  -  0.0061ER  +  0.Q035DR 

-  0.0097SD  -  0.0079BL2  -  0.0050ER2  -  0.0124DR2 

-  0.0037SD2  +  0.0029BL*ER  +  0.0024BL*DR 

-  0 . 0007B L*SD  +  0.001 2ER*DR  +  0.0074ER*SD 

-  0.0042 DR *SD 


R2  = 


080 


Analysis 


Table  B.5 

of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  DSP/TYP 


ANOVA  SUMMARY 

’  TABLE 

Source 

df 

SS 

F 

£ 

Regression 

(14) 

0.77597 

2.75 

0.0007 

Buffer  Length  (3L) 

1 

0.07464 

3.71 

0.0548 

Echo  Rate  (ER) 

1 

0.51951 

25.82 

0.0001 

Display  Rate  (OR) 

1 

0.00601 

0.30 

0.5848 

System  Delay  (3D) 

1 

0.01594 

0.79 

0.3739 

BL2 

1 

0.00984 

0.49 

0.4844 

ER2 

1 

0.00385 

0.19 

0.6621 

DRt 

1 

0.06543 

3.25 

0.0720 

SO2 

1 

0.00894 

0.44 

0.5053 

BL*ER 

1 

0.00442 

0.22 

0.6395 

B  L*DR 

1 

0.05505 

2.74 

0.0989 

BL*SD 

1 

0.00083 

0.04 

0.8384 

ER*DR 

1 

0.00000 

0.00 

0.9846 

ER*SD 

1 

0.00082 

0.04 

0.8393 

DR*3D 

1 

0.01056 

0.52 

0.4692 

Residual 

335 

7.74747 

To  tal 

399 

8.52345 

SECOND 

-ORDER  POLYNOMIAL  REGRESS 

ION 

DSP/TYP  =  0.2424  -  0.01523L  +  0.0402ER  -  0.Q043DR 

+  0.00703D  +  0.00373L2  -  0.0054ER2  -  0.0226DR2 
+  0.0083SD2  -  0.0041BL*ER  +  0.0146BL*DR 
+  0 . 00 18BL*SD  +  0.0001ER*DR  -  0.0017ER*5D 
+  0 . 0064DR*3D 


R2  =  .091 


B-5 


Table  B.6 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  KBD/TYP 


AN OVA  SUMMARY 

TABLE 

Source 

df 

S3 

F 

£ 

Regression 

(14) 

3.21812 

14.25 

0.0001 

Buffer  Length  (3L) 

1 

0.0107 

0.67 

0.4150 

Echo  Rate  (ER) 

1 

0.99864 

61.90 

0.0001 

Display  Rate  (DR) 

1 

0.00118 

0.07 

0.7865 

System  Delay  (3D) 

1 

1.89195 

117.28 

0.0001 

3L2 

1 

0.00052 

0.03 

0.3570 

ER2 

1 

0.01680 

1.04 

0.3031 

DR^ 

1 

0.01951 

1.21 

0.2719 

SD2 

1 

0.02314 

1.43 

0.2317 

BL*ER 

1 

0.03762 

2.33 

0.1275 

3L*0R 

1 

0.00000 

0.00 

0.9381 

3L*SD 

1 

0.06015 

3.73 

0.0542 

ER*DR 

1 

0.01243 

0.77 

0.3806 

ER*3D 

1 

0.14006 

3.68 

0.0034 

0R*3D 

1 

0.00531 

0.33 

0.5662 

Residual 

385 

6.21102 

To  tal 

399 

9.42914 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


KBD/TYP  =  0.2751  +  0.00573L  -  0.0558ER  +  0.Q019DR 

-  0.07683D  -  0.0020BL2  +  0.0114BR2  +  0.012308“ 

-  0.0134SD2  -  0 . 0 1 2 1BL*ER  -  0.0001BL*DR 

+  0 . 0  1 5  3BL*3D  -  0.0069ER*DR  +  0.0233ER*SD 
+  0 . 0045DR*3D 


R2  =  . 


341 


Table  B.7 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  TRATE 


AN OVA  SUHMARy 

'  TABLE 

Source 

df 

SS 

F 

£ 

Regression 

(14) 

0.01341 

43.60 

0.0001 

Buffer  Length  (3L) 

1 

0.00030 

10.06 

0.0016 

Echo  Rate  (SR) 

1 

0.01603 

531.64 

0.0001 

Display  Rate  (OR) 

1 

0.00014 

4.69 

0.0309 

System  Delay  (SO) 

1 

0.00000 

0.01 

0.9240 

BL2 

1 

0.00012 

4.14 

0.0426 

ER2 

1 

0.00041 

13.90 

0.0002 

DR2 

1 

0.00000 

0.00 

0.9543 

SD2 

1 

0.00001 

0.34 

0.5579 

8L*ER 

1 

0.00049 

16.54 

0.0001 

3L*DR 

1 

0.00013 

4.50 

0.0345 

BL*3D 

1 

0.00019 

6.45 

0.0115 

ER*DR 

1 

0.00041 

13.70 

0.0002 

ER*3D 

1 

0.00000 

0.33 

0.5666 

DR*3D 

1 

0.00012 

4.17 

0.0419 

Residual 

335 

0.01161 

Total 

399 

0.03002 

SECOND 

-ORDER  POLYNOMIAL  REGRESSION 

PRATE  =  0.020  t  0.0003L  -  0.Q07ER  +  0.0Q0DR 

-  0.00003D  -  O.OOOBL2  +  0.001ER2  -  0.0000DR2 
+  0.0003D2  +  0 . 0 0 1BL*ER  -  0.000BL*DR 

-  0 . 000BL*SD  -  0 . 00 1ER*DR  -  0.000ER*3D 

-  0 . 000DR*3D 


R2  =  . 


613 


Table  B.8 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  FE/URT 


AN  OVA 

SUMMARY  TABLE 

Source 

df 

SS 

F  ■ 

£ 

Regression 

(14) 

305970.28 

9.32 

0.0001 

Buffer  Length  (BL) 

1 

145.03 

0.06 

0.8037 

Echo  Rate  (ER) 

1 

552.28 

0.24 

0.6278 

□i spl ay  Rate  (DR) 

1 

6907.27 

2.95 

0.0869 

System  Delay  (3D) 

1 

228921.60 

97.60 

0.0001 

BL2 

1 

37.09 

0.02 

0.9013 

ER2 

1 

3969.50 

1.69 

0.1941 

dr; 

1 

5626.22 

2.40 

0.1222 

SO^ 

1 

40835.15 

17.41 

0.0001 

3L*ER 

1 

6045.06 

2.58 

0.1092 

BL*DR 

1 

1914.06 

0.82 

0.3669 

8  L*  SD 

1 

1207.56 

0.51 

0.4735 

£R*DR 

1 

2013.76 

0.86 

0.3547 

E  R  *  3  D 

1 

968.76 

0.41 

0.5208 

DR*3D 

1 

6326.39 

2.91 

0.0888 

Res  idual 

335 

902933.09 

Total 

399 

1208953.37 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


FE/URT  =  44.924  +  0.673BL  -  1.313ER  -.4.646DR 

-  25.747SD  +  0.531BL2  +  5.563ER2  +  6.626DR2 
4-  17.864SD2  -  4 . 8598L*ER  -  2.734BL*DR 
+  2.17 1BL*3D  +  2.80 4ER*DR  -  1.945Brt*SD 
+  5 . 1 64DR*SD 


R2  =  .253 


B-3 


Analysis  of  Variance 
Polynomial 


Table  B.9 

Summary  Table  of  Second-Order, 
Regression  of  NF/URT 


[  ANOVA  SUMMARY  TABLE 


Source 

df 

SS 

F 

E 

Regression 

(14) 

38212.84 

2.45 

0.0026 

Buffer  Length  (BL) 

1 

1416.73 

1.27 

0.2603 

Echo  Rate  (ER) 

1 

2795.35 

2.51 

0.1141 

Display  Rate  (OR) 

1 

1824.75 

1.64 

0.2015 

System  Delay  (SD) 

1 

18736.47 

16.31 

0.0001 

BL2 

1 

582.35 

0.61 

0.4342 

ER2 

1 

772.54 

0.69 

0.4058 

DRZ 

1 

1509.22 

1.36 

0.2451 

SD2 

1 

6166.35 

5.53 

0.0192 

3L*ER 

1 

9.00 

0.01 

0.9284 

BL*QR 

1 

107.64 

0.10 

0.7562 

BL*SD 

1 

222.76 

0.21 

0.6508 

SR*QR 

1 

1827.56 

1.64 

0.2012 

ER*3D 

1 

189.06 

0.17 

0.6807 

DR*3D 

1 

1947.01 

1.75 

0.1871 

Residual 

335 

429149.19 

Total 

399 

457362.04 

SECOND- 

ORDER 

POLYNOMIAL  REGRESS 

ION 

NF/URT  =  51.508  -  2.104BL  -t-  2.955ER  -  2.38SDR 

-  7.65230  -  2.310BL2  +  2.456ER2  -  3.436DR2 
+  6.9423D2  +  0 . 187BL*ER  -  0.648BL*DR 
+  0.945BL*SD  +  2.671ER*DR  -  0.859ER*SD 
+  2 . 7  57DR*3D 


R2  =  .081 


B-9 


Tabl s  B.10 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  FE/RT 


ANOVA  SUMMARY  TABLE 


Source 

df 

SS 

F 

£ 

Regression 

(14) 

4247357.34 

23.04 

0.0001 

Buffer  Length  (BL) 

1 

45327.41 

3.44 

0.0643 

Echo  Rate  (ER) 

1 

5749.53 

0.44 

0.5091 

Display  Rate  (DR) 

1 

52538 .16 

4.75 

0.0299 

System  Delay  (SD) 

1 

3850652.69 

293.22 

0.0001 

1 

1440.58 

0.11 

0.7405 

1 

14990.31 

1.14 

0.2862 

DR2 

1 

7424.57 

0.56 

0.4536 

SO* 

1 

108013.11 

8.20 

0.0044 

SL*ER 

1 

27163.16 

2.06 

0.1517 

BL*DR 

1 

71.19 

0.01 

0.9414 

BL*3D 

1 

46359.47 

3.52 

0.0613 

ER*DR 

1 

201.28 

0.02 

0.9017 

ER*3D 

1 

1985.31 

0.15 

0.6930 

DR*  3D 

1 

55440.03 

4.97 

0.0264 

Residual 

385 

5069023.35 

To  tal 

399 

9316330.71 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


FE/RT  =  83.889  +  11.901BL  -  4.233ER  +  13.980DR 

+  109.342SD  -  3.361BL2  -  10.332ER2  +  7.610DR2 
+  29.0543D2  -  1 0 . 300BL*ER  -  0.527BL*DR 
+  1 3 . 457BL*SD  +  0.886ER*DR  -  2.785ER*3D 
+  1 5 . 988DR*3D 


R2  =  . 


455 


Table  B.ll 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  NF/RT 


AN  OVA 

SUMMARY  TABLE 

Source 

df 

SS 

F 

£ 

Regression 

(14) 

3316465.67 

19.73 

0.0001 

Buffer  Length 

( 3L) 

1 

23215.30 

1.94 

0.1646 

Echo  Rate  (ER) 

1 

22553.15 

1.88 

0.1707 

Display  Rate 

(DR) 

1 

12233.77 

1.02 

0.3127 

System  Delay 

(3D) 

1 

3024378.77 

252.59 

0.0001 

3L2 

1 

162.70 

0.01 

0.9079 

ER2 

1 

655.53 

0.06 

0.8145 

DR2 

1 

47.07 

0.00 

0.9494 

3D2 

1 

148639.03 

12.41 

0.0005 

BL*ER 

1 

36409.41 

3.04 

0.0820 

3L*DR 

1 

190.78 

0.02 

0.8996 

3L*SD 

1 

19757.81 

1.65 

0.1997 

ER*DR 

1 

1093.12 

0.09 

0.7627 

ER*3D 

1 

12953.28 

1.08 

0.2989 

DR*3D 

1 

14175.67 

1.18 

0.2772 

Residual 

335 

4609797.72 

Total 

399 

7926263.39 

SECOND- 

■ORDER 

POLYNOMIAL  REG 

RESSI0N 

NF/RT  =  65.470  +  3.517BL  -  8.395ER  +  6.183DR 

+  97.220SD  +  1.120BL2  -  2.271ER2  -  0.614DR2 
+■  34.083SD2  -  1  1 . 925Bt*ER  +  0.863BL*DR 
+  3 . 78 53L*SD  -  2.066£R*DR  -  7.113ER*SD 
+  7 . 4  4 1DR*3D 


R2  = 


413 


Tabl 9  B.12 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  RDRSP 


ANOVA  SUMMARY  TABLE 


Source 

df 

SS 

P 

£ 

Regression 

(14) 

10810.53 

15.27 

0.0001 

Buffer  Length  (3L) 

1 

51.39 

1.03 

0.3117 

Echo  Rate  (ER) 

1 

8.88 

0.18 

0.6754 

Display  Rate  (DR) 

1 

6.10 

0.12 

0.7284 

System  Delay  (3D) 

1 

10075.54 

199.26 

0.0001 

BL2 

1 

168.90 

3.34 

0.0685 

ER2 

1 

114.38 

2.26 

0.1334 

DR2 

1 

92.77 

1.84 

0.1763 

SD2 

1 

6.58 

0.13 

0.7184 

BL*ER 

1 

59.09 

1.17 

0.2803 

BL*DR 

1 

29.56 

0.58 

0.4449 

3L*SD 

1 

75.47 

1.49 

0.2226 

ER*DR 

1 

103.78 

2.05 

0.1528 

ER*3D 

1 

17.53 

0.35 

0.5563 

DR*3D 

1 

0.00 

0.00 

0.9930 

Residual 

335 

19467.21 

Total 

399 

30277.75 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


RDRSP  =  3.799  +  0.402BL  +  0.166ER  +  0.138DR 

+  5.611SD  -  1.143BL2  -  0.945ER2  -  0.851DR2 
+  0.2253D2  -  0 . 480BL*ER  --  0.339BL*DR 
+  3 . 54 2BL*SD  -  0.636ER*DR  +  3.261ER*SD 
-  9 . 00 3DR*3D 


Table  B.13 

Analysis  of  Variance  Summary  Table  of  Second-Order, 

Polynomial  Regression  of  CHER 


ANOVA 

SUMARY  TABLE 

Source 

df 

SS 

F 

£ 

Regression 

(14) 

226.14 

1.86 

0.0297 

Buffer  Length  (BL) 

1 

15.63 

1.80 

0.1810 

Echo  Rate  (ER) 

1 

101.42 

11.65 

0.0007 

Display  Rata  (DR) 

1 

9.75 

1.12 

0.2905 

System  Delay  (SD) 

1 

1.25 

0.14 

0.7049 

BL2 

1 

22.95 

2.64 

0.1053 

ER2 

1 

32.19 

3.70 

0.0552 

DR2 

1 

15.25 

1.75 

0.1864 

SD2 

1 

4.43 

0.51 

0.4759 

BL*ER 

1 

3.75 

0.43 

0.5118 

BL*DR 

1 

2.06 

0.24 

0.6264 

8L*SD 

1 

0.66 

0.08 

0.7832 

ER*DR 

1 

5.94 

0.68 

0.4093 

ER*3D 

1 

10.16 

1.17 

0.2807 

DR*3D 

1 

0.66 

0.08 

0.7832 

Residual 

335 

3351.75 

Total 

399 

3577.89 

SECOND- 

■ORDER  ! 

POLYNOMIAL  REGRESSION 

CHER  =  2.814  -  0.221BL  +  0.562ER  +  0.174DR 

+  0.062SD  -  0.423BL2  -  0.501ER2  -  0.345DR2 
+  0.1863D2  +  0 . 1213L*ER  +  0.089BL*DR 
+  0 . 050BL*SD  -  0 . 152ER*DR  +  0.199ER*SD 
-  0 . 050DR*5D 


R2  =  .063 


B-13 


Table  B.14 

Analysis  of  Varianca  Summary  Tabla  of  Second-Order, 

Polynomial  Regression  of  CKT 


ANOVA  SUMMARY  TABLE 


Source 

df 

SS 

£ 

£ 

Regression 

(14) 

2876003.23 

1.97 

0.0138 

Buffer  Length  (BL) 

1 

100336.95 

0.97 

0.3257 

Echo  Rate  (ER) 

1 

144235.99 

1.39 

0.2399 

Display  Rate  (DR) 

1 

1177252.43 

11.31 

0.0008 

System  Delay  (SD) 

1 

71005.53 

0.68 

0.4094 

BL2 

1 

19272.11 

0.18 

0.6675 

ER2 

1 

79005.14 

0.76 

0.3844 

DR2 

1 

26.58 

0.00 

0.9871 

SD2 

1 

54919.20 

0.53 

0.4681 

BL*ER 

1 

195750.94 

1.88 

0.1711 

BL*DR 

1 

114793.91 

1.10 

0.2944 

BL*SD 

1 

506143.31 

4.86 

0.0231 

SR*DR 

1 

16523.31 

0.16 

0.6905 

ER*3D 

1 

65243.31 

0.63 

0.4291 

DR*3D 

1 

330984.47 

3.18 

0.0754 

Residual 

335 

40083219.87 

To  tal 

399 

42964223.11 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


CKT  =  152.69  -  17.75BL  +  21.23ER  -  6Q.65DR 

-  14.39SD  +  12.26BL2  +  24.84ER2  -  0.46DR2 
+  20.71SD2  -  27 . 65BL*ER  +  21.17BL*DR 
+  4 4 . 468L*3D  -  3.03ER*DR  -  15.96ER*SD 
+  35 ,95DR*3D 


Table  B.15 

Analysis  of  Variance  Summary  Table  of  Second-Order, 

Polynomial  Regression  of  TONR 


ANDVA 

SUMMARY  TABLE 

Source 

df 

SS 

I 

£ 

Regression 

(14) 

260.86 

3.58 

0.0001 

Buffer  Length  (8L) 

1 

0.07 

0.01 

0.9032 

Echo  Rate  (ER) 

1 

118.37 

22.73 

0.0001 

Display  Rate  (DR) 

1 

22.05 

4.23 

0.0403 

System  Delay  (SD) 

1 

8.76 

1.68 

0.1953 

BL* 

1 

4.20 

0.81 

0.3696 

ER2 

1 

17.40 

3.34 

0.0634 

OR2 

1 

1.80 

0.35 

0.5566 

SD2 

1 

4.30 

0.92 

0.3372 

BL*ER 

1 

10.56 

2.03 

0.1553 

BL*DR 

1 

10.56 

2.03 

0.1553 

BL*SD 

1 

33.60 

6.35 

0.0122 

ER*DR 

1 

5.06 

0.30 

0.5842 

ER*3D 

1 

1.56 

0.97 

0.3248 

DR*3D 

Residual 

Total 

1 

335 

399 

22.56 

2005.49 

2266.36 

4.33 

0.0331 

SECOND- 

■ORDER 

POLYNOMIAL  REGRESSION 

TONR  =  5.910  +  0.015BL  -  0.608ER  +  0.262DR 

-  0.165SD  +  0.131BL2  +  0.368ER2  +  0.118DR2 

-  0.193SD2  -  0 . 20  3BL*ER  -  0.203BL*DR 

-  0 . 3593L*SD  -  0.078ER*DR  +  0.140ER*3D 

-  0 . 29  6DR*SD 


Table  B.16 


Analysis  of  Variance 

Summary 

Table  of  Second-Order, 

Polynomial 

Regression  of 

SDR 

AN  OVA 

SUMMARY  TABLE 

Source 

df 

SS 

F 

£ 

Regression 

(14) 

789.52 

30.95 

0.0001 

Buffer  Length  (BL) 

1 

0.09 

0.05 

0.8149 

Echo  Rate  (ER) 

1 

20.00 

10.98 

0.0010 

Display  Rate  (DR) 

1 

1.33 

0.73 

0.3921 

System  Delay  (SD) 

1 

693.83 

380.81 

0.0001 

3L2 

1 

4.50 

2.47 

0.1170 

ER2 

1 

3.00 

4.39 

0.0368 

DR2 

1 

8.00 

4.39 

0.0368 

SD2 

1 

17.99 

9.88 

0.0018 

BL*ER 

1 

4.00 

2.20 

0.1392 

3L*DR 

1 

1.00 

0.55 

0.4592 

3L*3D 

1 

2.25 

1.23 

0.2671 

ER*DR 

1 

16.00 

8.78 

0.0032 

ER*3D 

1 

6.25 

3.43 

0.0648 

DR*3D 

1 

6.25 

3.43 

0.0648 

Residual 

335 

701.47 

Total 

399 

1491.00 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


SDR  =»  2.100  +  0.0178L  -  0.250SR  +  0.Q64DR 

-  1.472SD  f  0.187SL2  +  0.249ER2  +  0.249DR2 
+  0.3753D2  -  0 . 1 25BL*ER  -  0.062BL*DR 

>  0 . 09  3BL*SD  +  0.250ER*DR  +  0,156ER*SD 

-  0 . 1 56DR*3D 


R2  =  .529 


B-l  6 


Table  B.17 

Analysis  of  Variance  Summary  Table  of  Second-Order, 

Polynomial  Regression  of  DSPR 


ANOVA  SUMMARY  TABLE 


Source 

df 

SS 

F 

£ 

Regression 

(14) 

249.96 

4.54 

0.0001 

Buffer  Length  (BL) 

1 

1.28 

0.33 

0.5679 

Echo  Rate  (ER) 

1 

3.89 

0.99 

0.3201 

Display  Rate  (DR) 

1 

26.05 

6.63 

0.0104 

System  Delay  (3D) 

1 

28.22 

7.18 

0.0077 

BL2 

1 

49.98 

12.72 

0.0004 

ER2 

1 

84.51 

21.49 

0.0001 

DR2 

1 

0.49 

0.13 

0.7219 

SDZ 

1 

1.99 

0.51 

0.4764 

BL*ER 

1 

12.25 

3.12 

0.0734 

3L*DR 

1 

36.00 

9.15 

0.0026 

BL*3D 

1 

0.00 

0.00 

1.0000 

ER*DR 

1 

1.00 

0.25 

0.6144 

ER*3D 

1 

4.00 

1.02 

0.3138 

DR*3D 

1 

0.25 

0.06 

0.8011 

Residual 

385 

1514.03 

Total 

399 

1764.00 

SECOND-ORDER  POLYNOMIAL  REGRESSION 


DSPR  =  4.200  +  0.063BL  -0.1101ER  -  0.285DR 

-  0.2963D  -  0.625BL2  +  0.312ER2  +  0.062DR2 
+  0.124SD2  +  0 . 2 1 38L*ER  -  0.3753L*DR 
+  0 . OOOBL*SD  -  0 . 06  2ER*DR  +  0.125ER*3D 
+  0.031DR*3D 


Table  B.18 

Analysis  of  Variance  Summary  Table  of  Second-Order , 

Polynomial  Regression  of  ERR 


ANOVA  SIMMARY  TABLE 

Source 

df 

SS 

F 

£ 

Reg  ression 

(14) 

732.03 

28.69 

0.0001 

Buffer  Length  (3L) 

1 

4.66 

2.56 

0.1106 

Echo  Rate  (ER) 

1 

6543.20 

358.93 

0.0001 

Display  Rate  (DR) 

1 

4.66 

2.56 

0.1106 

System  Delay  (3D) 

1 

12.63 

6.93 

0.0038 

QL2 

1 

0.08 

0.04 

0.8349 

ER* 

1 

14.58 

3.00 

0.0049 

1 

0.08 

0.04 

0.8349 

SD^ 

1 

27.37 

15.02 

0.0001 

3L*ER 

1 

1.00 

0.55 

0.4593 

3L*DR 

1 

9.00 

4.94 

0.0259 

BL*SD 

1 

0.25 

0.14 

0.7113 

£R*DR 

1 

1.00 

0.55 

0.4593 

ER*3D 

1 

2.25 

1.23 

0.2672 

DR*3D 

1 

0.25 

0.14 

0.7113 

Residual 

385 

701.72 

Total 

399 

1433.76 

SECOND 

-ORDER  POLYNOMIAL  REGRESSION 

ERR  =  2.660  -  0.120BL 

-  1.429ER 

-  0.120DR 

-  0.193SD  +  0.02431.  +  0. 

3  37ER^  +  0.02  4DRZ 

+  0 ,462SO^  -  0 . 

0  6  2B  L*ER  - 

0 . 187BL*DR 

-  0.03 13L*3D  - 

0.06  2ER*DR 

-  0 . 09  3ER*3D 

+  0.0  31DR*  3D 

R2 

=  .510 

B-13 


Table  B.19 

Analysis  of  Variance  Summary  Table  of  Second-Order, 

Polynomial  Regression  of  BLR 


ANOVA 

SUMMARY  TABLE 

Source 

df 

S3 

F 

£ 

Regression 

(14) 

640.64 

22.99 

0.0001 

Buffer  Length 

(BL) 

1 

98.94 

49.71 

0.0001 

Echo  Rate  (ER) 

1 

298.87 

150.14 

0.0001 

Display  Rate 

(DR) 

1 

0.03 

0.02 

0.8957 

System  Delay 

(3D) 

1 

26.61 

13.37 

0.0003 

BL2 

1 

25.90 

13.03 

0.0003 

ER2 

1 

58.34 

29.29 

0.0001 

DR2 

SD2 

1 

3.92 

1.97 

0.1616 

1 

48.01 

24.12 

0.0001 

3L*ER 

1 

72.25 

36.30 

0.0001 

BL*DR 

1 

0.25 

0.13 

0.7232 

BL*SD 

1 

1.00 

0.50 

0.4789 

£R*DR 

1 

0.00 

0.00 

1.0000 

ER*3D 

1 

6.25 

3.14 

0.0772 

OR*3D 

Res  idual 

Total 

1 

335 

399 

0.25 

766.39 

1407.04 

0.13 

0.7232 

SECOND- 

ORDER 

POLYNOMIAL  REG 

RESSION 

BLR  =  2.870  +  0.555BL  -  0.966ER  +  0.101DR 

-  O.Z93SD  -  0.4503L2  +  0.675ER2  +  0.174DR2 
+  0.512SD2  +  0 . 5313L*ER  -  0.031SL*DR 

-  0 . Q62BL*3D  +•  0.000ER*DR  -  0.156ER*3D 

-  0.031DR*3D 


R2  =  .455 


B-19 


I 


Ta b  1  2  B  .  20 


Analysis  of  Variance 

Summary 

Table  of  Second 

-Order , 

Polynomial 

Regression  of  SPEED 

ANOVA 

SUMMARY  TABLE 

Source 

df 

§1 

F 

£ 

Regression 

(14) 

2016.20 

38.89 

0.0001 

Buffer  Length  (BL) 

1 

20.98 

5.67 

0.0178 

Echo  Rate  (ER) 

1 

1038.87 

280.57 

0.0001 

Display  Rate  (DR) 

1 

8.99 

2.43 

0.1199 

System  Delay  (SD) 

1 

486.36 

131.35 

0.0001 

BL2 

1 

0.18 

0.05 

0.3263 

ER2 

1 

106.62 

28.77 

0.0001 

DRt 

1 

15.68 

4.23 

0.0404 

SO2 

1 

137.74 

37.20 

0.0001 

BL*£R 

1 

4.00 

1.08 

0.2993 

BL*DR 

1 

12.25 

3.31 

0.0697 

8L*SD 

1 

6.25 

1.69 

0.1947 

ER*DR 

1 

9.00 

2.43 

0.1198 

ER*3D 

1 

169.00 

45.64 

0.0001 

DR*SD 

1 

0.25 

0.07 

0.7951 

Residual 

335 

1425.55 

Total 

399 

3441.76 

SECOrtD 

-ORDER 

POLYNOMIAL  REGRS 

SS  ION 

SPEED  =  1.790  +■  0.256BL  -  1.801ER  -  0.167DR 

-  1.232SD  +  0.037BL2  +  0.912ER2  +  0.349DR2 
+  1.037SD2  v  0 . 1 25BL*ER  -  0.213BL*DR 

-  0 . 1 56BL*SD  +  0 . 137ER*DR  f  0.312ER*3D 
+  0 . 0  31DR*3D 


R2  =  .585 


B-20 


Tab  la  B.21 

Analysis  of  Variance  Summary  Table  of  Second-Order, 

Polynomial  Regression  of  ACCUR 


ANOVA  SUMMARY  TABLE 

Source 

df 

SS 

F 

£ 

Regression 

(14) 

1579.03 

23.78 

0.0001 

Suffer  Length  (3L) 

1 

14.36 

3.13 

0.0775 

Echo  Rate  (ER) 

1 

935.71 

197.27 

0.0775 

Display  Rate  (DR) 

1 

4.36 

0.92 

0.3380 

System  Delay  (3D) 

1 

232.64 

49.05 

0.0001 

3L2 

1 

0.04 

0.01 

0.9234 

ER2 

1 

108.07 

22.77 

0.0001 

DR2 

1 

3.64 

0.77 

0.3819 

SD2 

1 

93.31 

19.78 

0.0001 

3L*  ER 

1 

0.06 

0.01 

0.9037 

3L*DR 

1 

13.06 

3.81 

0.0517 

BL*SD 

1 

27.56 

5.31 

0.0164 

ER*DR 

1 

27.56 

5.31 

0.0164 

ER*  3D 

1 

105.06 

22.15 

0.0001 

Drt*5D 

1 

7.56 

1.59 

0.2075 

Res  idual 

335 

1826.20 

Total 

399 

3405.24 

SECOND- 

ORDER  POLYNOMIAL  REGRESSION 

ACCUR  =  2.330  4-  0.215BL  -  1.710ER 

-  0.116DR 

-  0 .352SD  4-  0  . 

0 1 9B  L^  4-  0. 

9  1 3ER^  4-  O.ieSDR^ 

+  0  . 3 56SD2  +  0 

. 0 1 5B L* ER  - 

0 ,265BL*DR 

-  0.3236L*3D  4- 

0 . 323ER*DR 

+  0 . 540ER*SD 

4-  0.17  1DR*3D 

R2  = 

.463 

B-21 


Table  B.22 

Analysis  of  Variance  Summary  Table  of  Second-Order, 

Polynomial  Regression  of  OVER 


AN  OVA 

SUMMARY  TABLE 

Source 

df 

SS 

F 

£ 

Re  g  r ess  ion 

(14) 

1734.38 

29.67 

0.0001 

Suffer  Length 

(3L) 

1 

11.61 

2.78 

0.0951 

Echo  Rate  (ER) 

1 

1007.80 

241.39 

0.0001 

Display  Rate 

(OR) 

1 

29.30 

7.14 

0.0079 

System  Delay 

(3D) 

1 

269.26 

64.49 

0.0001 

BL2 

1 

0.00 

0.00 

0.9736 

ER2 

1 

146.24 

35.01 

0.0001 

DR^r 

1 

3.40 

2.01 

3.1571 

3D2 

1 

99.36 

23.30 

0.0001 

8L*ER 

1 

3.06 

0.73 

0.3923 

BL*DR 

1 

3.06 

0.73 

0.3923 

3  L*SD 

1 

22.56 

5.40 

0.0206 

ER*  DR 

1 

27.56 

6.60 

0.0106 

ER*3D 

1 

105.06 

25.16 

0.0001 

DR*3D 

1 

0.56 

0.13 

0.7138 

Residual 

335 

1607.37 

Total 

399 

3341.75 

SECOND- 

ORDER 

POLYNOMIAL  REG 

RESSI0N 

OVER  =  2.390  +  0.19031.  -  1.774ER  -  0.305DR 

-  0.917SD  +  0.0053L2  +  1.063ER2  +  0.256DR2 
v  0.3313D2  f  0  . 1 093  L*  ER  -  0.1093L*DR 

-  0 . 0  2  93  l.*3D  +  0.3  23ER*DR  +  0.640ER*3D 
+  0.046DR*3D 


R2 
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APPENDIX  C 

ANALYSIS  OF  VARIANCE  SUMMARY  TABLES 
MULTIVARIATE  ANALYSES 


C-0 


Table  C.l 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  PRODUCTION 


ANOVA 

SUMMARY  TABLE 

Source 

df 

S3 

F 

£ 

Regression 

(14) 

243.88 

45.60 

0.0001 

Buffer  Length  (3L) 

1 

1.35 

3.48 

0.0630 

Echo  Rate  (ER) 

1 

105.71 

271.14 

0.0001 

Display  Rate  (DR) 

1 

0.75 

1.93 

0.1654 

System  Delay  (SO) 

1 

116.34 

298.39 

0.0001 

bl; 

1 

0.06 

0.16 

0.6889 

ER2 

1 

11.31 

29.02 

0.0001 

OR2 

1 

0.64 

1.65 

0.1996 

SD2 

1 

4.76 

12.23 

0.0005 

BL*ER 

1 

0.77 

2.00 

0.1582 

8L*DR 

1 

1.05 

2.71 

0.1008 

BL*SD 

1 

1.12 

2.90 

0.0896 

ER*  DR 

1 

0.55 

1.41 

0.2356 

ER*SD 

1 

4.33 

11.12 

0.0009 

D  R  *  3  D 

1 

0  .07 

0.20 

0.6540 

Residual 

335 

150.11 

Total 

399 

399.00 

SECOND- 

ORDER 

POLYNOMIAL  REGRESSION 

PRODUCTION  =  -  0.4313  +  0.06503L  -  0.5747ER  -  Q.0435DR 

-  0.5029SD  -  0.02213L2  +  0.2973ER2  +  0.0709DR' 
+  0.1930SD2  +  0.0551BL*ER  -  0.0641BL*DR 

-  0 . 0664BL*3D  +  0.0463ER*DR  +  0.1301ER*SD 

-  0 . 0 1750R* 3D 


R2  =  .623 


Tabla  C.2 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  WAITING 


ANOVA 

SIMMARY  TA3LE 

Source 

df 

SS 

F 

£ 

Regression 

(14) 

206.62 

29.54 

0.0001 

Buffer  Length 

(3L) 

1 

5.38 

10.79 

0.0011 

Echo  Rate  (ER) 

1 

91.66 

183.45 

0.0001 

Display  Rate 

(OR) 

1 

2.21 

4.44 

0.0358 

System  Delay 

(3D) 

1 

93.02 

196.17 

0.0001 

BL2 

1 

0.76 

1.53 

0.2169 

ER2 

1 

2.25 

4.52 

0.0342 

DR2 

1 

0.39 

0.79 

0.3739 

S32 

1 

0.71 

1.4  3 

0.2323 

3L*ER 

1 

0.37 

0.76 

0.3848 

BL*DR 

1 

1.95 

3.91 

0.0438 

BL*SD 

1 

0.94 

1.88 

0.1706 

ER*DR 

1 

1.40 

2.81 

0.0944 

ER*3D 

1 

0.12 

0.25 

0.6193 

DR*  3D 

Residual 

Total 

1 

335 

399 

0.39 

192.37 

399.00 

0.78 

0.3770 

SECOND- 

-ORDER 

POLYNOMIAL  REG 

RESSION 

WAITING 


-  0.1437  +  0.1297BL  -  0.5352ER  +  Q.0832DR 

+  0.55343D  -  0.0773BL2  +  0.1328ER2  +  0.0556DR2 
+  0.07473D2  +  0.0384BL*ER  -  0.08738L*DR 

-  0.06053L*SD  -  0.0740ER*DR  +  0.0219ER*SD 

-  0 . 0 390DR*3D 


Table  C.3 

Analysis  of  Variance  Summary  Table  of  Second-Order, 
Polynomial  Regression  of  PLANNING 


ANOVA 

SUMMARY  TABLE 

Source 

df 

SS 

F 

E 

Regression 

(14) 

64.92 

5.34 

0.0001 

Buffer  Length  (BL) 

1 

0.26 

0.31 

0.5786 

Echo  Rate  (ER) 

1 

17.10 

19.71 

0.0001 

Display  Rate  (DR) 

1 

1.58 

1.83 

0.1769 

System  Delay  (SD) 

1 

22.46 

25.89 

0.0001 

SL2 

1 

0.16 

0.19 

0.6622 

ER2 

1 

1.36 

1.57 

0.2113 

dr; 

1 

0.13 

0.15 

0.6945 

SD^ 

1 

16.78 

19.34 

0.0001 

3L*ER 

1 

0.05 

0.06 

0.8003 

BL*DR 

1 

0.03 

0.04 

0.8329 

BL*3D 

1 

0.7  2 

0.84 

0.3597 

ER*DR 

1 

0.75 

0.87 

0.3502 

ER*3D 

1 

0.29 

0.34 

0.5577 

OR*3D 

1 

3.17 

3.66 

0.0566 

Residual 

385 

334.07 

To  tal 

399 

399.00 

SECOND- 

■ORDER 

POLYNOMIAL  REGRESSION 

PLANNING 


-  0.4263  4-  0.023BL  -  0.231ER  -  0.070DR 
+  0.264SO  4-  0.0363L2  4-  0.103ER2  4-  0.032DR2 
4-  0.362SD2  +  0.014BL*ER  4-  0.012BL*DR 
4-  0 . 053BL*3D  4-  0.054ER*DR  -  0.034ER*SD 
4-  0.11 10R*3D 


R2  =  .163 


C-3 


